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Abstract 

In this paper, we propose a new distributed coding structure with a soft input soft output (SISO) relay 
encoder for error-prone parallel relay channels. We refer to it as the distributed soft coding (DISC). In the 
proposed scheme, each relay first uses the received noisy signals to calculate the soft symbol estimate (SSE) 
of the source symbols. A simple SISO encoder is developed to encode the SSEs of source symbols based 
on a constituent code generator matrix. The SISO encoder outputs at different relays are then forwarded to 
the destination and form a distributed codeword. The performance of the proposed scheme is analyzed. It is 
shown that its performance is determined by the generator sequence weight (GSW) of the relay constituent 
codes, where the GSW of a constituent code is defined as the number of ones in its generator sequence. A 
new coding design criterion for optimally assigning the constituent codes to all the relays is proposed based on 
the analysis. Results show that the proposed DISC can effectively circumvent the error propagation due to the 
decoding errors in the conventional decode and forward (DF) protocols and at the same time bring considerable 
coding gains, compared to the conventional soft information relaying (SIR). 
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I. Introduction 

In wireless networks, the transmitted signal is overheard by all nodes in the vicinity of the transmitter. 
Similarly, a receiver can hear transmissions from multiple neighbouring nodes. This broadcast nature 
of wireless networks provides unique opportunities for collaborative and distributed signal processing 
techniques. Nodes other than the intended destination can listen to a signal at no additional transmission 
cost and it is globally efficient for these nodes to forward the information to the destination. This process 
of transmitting data from source to destination via one or more nodes is referred to as relaying, which 
has shown to yield spatial diversity and great power savings [1-2]. 

Two most frequently used relaying protocols in relay networks are amplify and forward (AF) and 
decode and forward (DF) [1-3]. Recently, some variations of AF and DF protocols have been proposed 
to further improve the performance of relayed transmission, such as selective DF (S-DF) [1], soft 
information relaying (SIR) and adaptive relaying protocol (ARP) [9]. Among them, the SIR scheme 
has recently attracted a lot of interest due to its superior performance [4-8, 23-28]. It is well known 
that the main performance degradation in a DF protocol is caused by the error propagation during the 
decoding and relay encoding process when decoding errors occur at the relay. One way of alleviating 
error propagation is to calculate and forward the corresponding soft information instead of making a 
decision based on the transmitted information symbols at the relay. Forwarding soft information at the 
relays provides additional information to the destination decoder to make decisions, instead of making 
premature decisions at the relay decoder. Thus SIR outperforms both AF and DF protocols. 

Recently, some distributed coding schemes have been proposed to exploit the spatial diversity and the 
distributed coding gains in wireless relay networks [10-17]. By applying the space time coding principle, 
distributed space time codes [10-13] have been proposed for wireless relay networks. To further improve 
the system performance, the distributed low density parity check (LDPC) codes [14, 15] and distributed 
turbo codes (DTC) [16-18] have been developed for a 2-hop single relay network. However, most of 
the existing distributed coding schemes are based on the DF relaying protocols and assume that either 
relays can always decode correctly or relays will not forward when they cannot decode correctly. Few 
of them have actually considered how to perform relay encoding when there are decoding errors in 
the source to relay links. In [4, 7, 8, 23], distributed schemes with soft information encoding have 
been developed for a relaying system containing only one relay when imperfect decoding occurs at the 
relay. In this scheme, instead of making decisions on the transmitted information symbols at the relay 
as in other distributed coding schemes [16-18], the relay calculates and forwards the corresponding 
soft estimates. It has been shown that the soft information encoding can effectively mitigate error 
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propagation caused by the imperfect decoding and thus improve the system performance. The soft 
information encoding methods proposed in these papers are basically a probability inference method 
developed for the convolutional codes. The encoding process is complicated and also it only considered 
one relay. 

Till now it is still unknown what is the optimal way to encode the noisy estimates of the source 
symbols to circumvent error propagation in the encoding process at the relay and simultaneously 
provide significant distributed coding gains. It is still unclear if encoding these noisy estimates can 
bring any further gains. A general framework for designing and analyzing distributed coding in a 
general error-prone relay channel is needed. 

In this paper, we propose a simple distributed coding scheme with soft input soft output (SISO) 
relay encoders for a two-hop parallel relay network with one source, multiple parallel relays and one 
destination. We refer to the proposed scheme as the distributed soft coding (DISC). In DISC, different 
relays exploit a SISO encoder to encode the received analog signals using different constituent codes. 
The proposed SISO relay encoder has a very simple encoding structure and can be implemented by 
using the structure of conventional channel encoders in the complex number domain. It performs the 
encoding of the noisy source symbol estimates at the relays. We have proved that the soft symbol 
estimates (SSEs), or known as "soft bits" representing the expected values of source symbols, are the 
optimal inputs to the SISO encoder in terms of maximizing the encoder output SNR. Therefore in 
the DISC each relay first calculates the SSEs of the source symbols and the SSEs are subsequently 
encoded by using the proposed SISO encoder, whose outputs are then forwarded to the destination. 
At the destination, the signals forwarded from various relays form a distributed codeword. 

The performance of the DISC is then analyzed. It is shown that its performance is determined by the 
generator sequence weights (GSWs) of the relay constituent codes, where the GSW of a constituent 
code is defined as the number of ones in its generator sequence. To optimize the BER performance, one 
should make the GSW of each constituent code as large as possible by increasing the memory length 
of the relay encoder. This is the same as for the conventional convolutional codes. However, the GSWs 
cannot be chosen arbitrarily, as the code may become catastrophic for certain combinations of GSW 
values. For most of conventional noncatastrophic convolutional codes, GSWs are different for different 
constituent codes. Given K GSWs of K constituent codes, we need to determine what is the optimal 
way of pairing off the K constituent codes with K relays. A coding design criterion is proposed based 
on the BER performance analysis of the DISC. It is shown that for the optimal pairing one should 
match the GSW value of a constituent code to the corresponding input SNRs of a relay and assign the 
constituent code with a large GSW to the relay with a large input SNR. Simulation results show that 
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the proposed DISC with optimal pairing is superior to the DISC with the un-ordered pairing. It is also 
shown that the DISC can effectively overcome error propagation in the encoding process at the relays 
and thus significantly outperforms the conventional DF schemes. Furthermore, unlike the DF scheme, 
where the error performance degrades as the number of encoder states increases, the performance of 
the proposed DISC greatly improves as the number of encoder states increases thus bringing significant 
distributed coding gains compared to the conventional soft information relaying (SIR) without relay 
encoding. 

The main contributions of the paper are briefly summarized as follows: 

• Design of a general soft input soft output channel encoder structure for any linear code, which 
can be described by a generator matrix. 

• Design of a general distributed soft encoding (DISC) scheme for encoding noisy estimates of the 
transmitted source symbols at relays; 

• Derivation of a simple performance bound and a new design criterion for DISC based on this 
bound for general parallel relay channels. 

Notations: In this paper, we use a lowercase and capital bold face letter to denote a vector and a 
matrix. The modulated signal of a symbol b(n) is denoted as x b (n) and the soft estimate of b(n), given 
its a posteriori probability, is denoted as x b (n). 

II. System Model 

In this paper, we consider a general 2-hop parallel relay network shown in Fig. 1. It consists of one 
source, K relays and one destination. We assume that there is no direct link between the source and 
destination as it is too weak compared to the relay links and is thus ignored. 

Let b = (6(1), • • • , 6(n), • • • , b(N)) be a binary information sequence of length N, generated by a 
source node. We assume that no channel coding is performed at the source node, b is first modulated 
into a signal sequence x b = (x 6 (l),--- ,x b (n),--- ,x b (N)) and then transmitted, where x b (n) is a 
modulated signal of b(n). For simplicity, in this paper, we consider the BPSK modulation and assume 
that the symbol and 1 are modulated into 1 and -1, respectively. Similar to [1, 2, 8, 9], we assume 
that the source and relays transmit signals over orthogonal channels. We will concentrate on a time 
division scheme, for which each node transmits in a separate time slot. The source first broadcasts the 
signals x b to all K parallel relays. Let r srk = (r sr (1), • • • ,r srk (N)) be the signals received at relay 
k, where 

r sr k (n) = \fP^~ k h srk x b in) + r] rk (n) , ( 1 ) 
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P STk = P s L srk is the average power received at relay k, P s is the source transmit power, L STk and h srk 
are the pathloss and channel gain between the source and relay k, and r] rk (n) is a zero mean complex 
Gaussian noise with variance of a^. 

Upon receiving signals from the source, relay k applies a SISO encoder to encode the received 
analog signals r srk by using its assigned rate-1 constituent code and generate the soft symbol es- 
timates (SSEs) for codeword c = (c(l),-- - ,c(n),--- ,c(N)) of information bits b, denoted by 
x Cfc = (x Cfc (l), • • • , x Ck (N)). Then the signals transmitted from relay k can be written as 

x rk (n) = /3 k x Ck (n), (2) 

j3 k is a normalization factor calculated from the transmitted power constraint at relay k, given by 

(3 k = yJP r /P Xk , (3) 

where P Xk = E (\x Ck (n)\ 2 ) and P Tk is the transmit power at relay k. The corresponding received signal 
at the destination can be written as 

Vr k d{n) = y/L~ d h rkd x rk {n) + w rkd {n) (4) 

where L Tk d and h r . kd are the pathloss and channel gain between relay k and the destination with a zero 
mean and unit variance, and is a zero mean complex Gaussian noise with variance of a^. 

As a result, different relays generate different portions of a codeword using different constituent 
codes and code sequences forwarded by all relays form a distributed codeword. 

III. Distributed Soft Coding with a SISO Relay Encoder 

In this section, we will design the relay function from a coding perspective and introduce a distributed 
soft coding (DISC) structure based on a SISO encoder for relay channels. It enables the relay to directly 
encode the source symbol soft estimates. 

A. SISO Encoder Using Generator Matrix 

In this subsection, we first introduce our proposed SISO encoder process using a single constituent 
code of rate 1 and then extend it to a general two-hop relay network using multiple constituent codes 
in Section 3.3. In this paper, we focus on the convolutional codes (CC). The results can be extended 
to other channel codes. In the interest of clarity, let us first consider a SISO encoder for a single 
constituent CC of four states. 

Example 1: We consider a rate-1 CC with the generator sequence of g P5 = (111) whose generator 
matrix G and the trellis diagram are shown below, where the superscript "PS" refers to the "polynomial 
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sequence", where m mi in the trellis represent the encoder state and m 8 denotes the value of the i+ 1- 
th shift register in the encoder. Let us denote by c = (c(l), • • • , c(N)) the encoder output codeword 
of information bits b, generated by the generator matrix G, where c(n) is the n-th code symbol of b. 
Let x c = (x c (l),x c (2), • • • ,x c (N)) represent the modulated sequence of c. 

Let r be a vector of analog signals, carrying information bits b = (6(1), • • • , b(N)). Let us denote 
the a posteriori probability (APP) vector of b, given r, by 

Pr r = {(Pr (l), Prx(l)) , • • • , (Pr (n), Pn(n)) , • • • , (Pr (W), Pri(iV))} (5) 

where Pr (n) and Pr\{n) are the APPs of 6(n) = and b(n) = 1, given r at time n. Given the APPs 
of b, the soft symbol estimate (SSE) (or known as the soft bit) of b(n), denoted by x b (n), representing 
the expected value of x b (n), can be calculated as 

Xb(n) = E(xb(n)\r) = Pr (n) — Pr\{n) (6) 

Given r, or equivalently, given the SSEs of information bits b, now let us look at how to calculate 
the SSEs of the codeword c(n) of b, denoted by x c (n). 

To calculate the SSEs of the codeword c, let us first use the probability inference method in [8] to 
calculate the probabilities of c, denoted by Pr (x c (n)\p r ), as follows 

Pr (x c (n) = q\p r ) = ^ Pr Cfc (n) Pr (S m (n)) (7) 

meU(xc(n)=q) 

Pr (S m (n + 1)) = Pr (S m (n)\S m ,(n)) Pr (S m ,(n)) = ^ Pr 6 „ (m , m0 (n) Pr (S m ,(n)) (8) 

m' m' 

where S (n), Si(n), 5* 2 (n) and S^(n) represent the encoder states of m mi=00, 01, 10 and 11 at time 
n, respectively, U(x c (n) = q) is the set of branches, whose encoder output is equal to q, c b is the 
corresponding input information bit, Pr Cft (n) is the probability of c& at time n, b n (m,m') represents 
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the input information bit resulting in the transition from state w! at time n to m at time n + 1, and 
P r 6„(m,m') ( n ) is the probability of information bit b n (m,m') at time n. 

As shown in £7]), the probability of encoder output x c (n) = q is equal to the summation of 
probabilities of branches whose output at time n is q, where the probability of each branch is equal 
to the multiplication of the probabilities of the originating state and corresponding input. Similarly 
according to ®, the probability of next state being m is equal to the summation of probabilities of 
branches at time n whose next state is m. 

Then according to © and ® and the trellis diagram in the Example 1, we have 

Pr (x c {n) = +l|p r ) = Pr(S (n))Pr (n) + Pr(5' 1 (n))Pri(n) + Pt(S 2 (n))Pr x (n) + Pr(S 3 (n))Pr (n) (9) 

Pr ( Xc (n) = -l|pr) = Pr(S (n))Pri(n) + Pr(£i(n))Pr (n) + Pr(£ 2 (n))Pr (n) + Pr(£ 3 (n))Pri(n)(10) 

Pr(£ (n + 1)) = Px(S (n))Pr (n) +Pr(S l (n))Pr (n); (11) 

Pr(5i(n + 1)) = Pr(5 2 (n))Pro(n) + Pr(S 3 (n))Pr (n); (12) 

Pr(5 2 (n + 1)) = Pr(5' (n))Pr 1 (n) + Pr(S' 1 (n))Pr 1 (n); (13) 

Pr(S , 3 (n + l)) = Pr(5 2 (n))Pri(n)+Pr(5 , 3 (n))Pri(n). (14) 

By using the above equations alternatively, we can derive the probability of encoder outputs at each 
time for the encoder shown in Example 1. Initially, we have Pr(S (0)) = 1 and Pr(Sj(0)) = 1 for 

• At time n = 1, substitute Pr (l), Pri(l) into ([TT ) -([T4 l) and ©-(HOI), we have 

Pr(S (l)) = Pr (l); Pr(5 x (l)) = 0; Pr(S 2 (l)) = Pn(l); Pr(5 3 (l)) = 0; 

Pr(x c (l) = +l|p r ) = Pr (l); Pr (x c (l) = -l|p r ) = Pr^l) 

x c (l) = Pr (x c (l) = +l| Pr ) - Pr (x c (l) = -l|p r ) = Pr (l) - Pn(l) = x b (l); 

• Similarly, at time n =2, we have 

Pr(S Q (2)) = Pr (2)Pr (l); Pr(^(2)) = Pr (2)Pr 1 (l); 
Pr(S 2 (2)) = Pn(2)Pr (l); Pr(5 3 (2)) = Pr 1 (2)Pr 1 (l); 
Pr(x c (2) = +l|p r ) = Pr (2)Pr (l) +Pr 1 (2)Pr 1 (l); 
Pr (x c (2) = -l|p P ) = Pn(2)Pr (l) + Pr (2)Pr 1 (l) 

x c (2) = Pr (x c (2) = +l| Pr )-Pr (x c (2) = -l|p r ) = (Pr (2)-Pr 1 (2))(Pr (l)-Pr 1 (l)) = x b (2)x b (l); 
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By following the similar calculations, (fTTj) - (PT4)) and x c (n) can be easily generalized for n > 2 as 
follows, 

Pr(S {n)) = Pr {n)Pr {n -1); PriS^ri)) = Pr {n)Pri{n-l); (15) 
P r (S 2 (n)) = P ri (n)Pr (n-l);Pr(S 3 (n)) = P ri (n)P ri (n-l)] (16) 

x c {n) = x b (n)x b (n - l)x b (n - 2) (17) 

Let us define ln5q, = (lnx&(l), • • • ,lnx b (N)) and lnx c = (ln£ c (l), • • • ,lnx c (N)), where for a 
complex number x = re^ 9 , lnx = In |r| + jQ. Therefore, for a negative real number x < 0, In a; = 
In |x| + J7T. Then Eq. (fTTT) can be further written as 

lnx c (n) = \nx b (n) + lnx fe (n — 1) + lnx b (n — 2) = g n (lnx b ) T (18) 

lnx c = G(lnx b ) T (19) 

where g n is the n-th row of G. 

(fT8l and (TT9l) are derived for an example constituent convolutional code (CC), but they can be applied 
to the general convolutional codes and other channel codes, which can be described by a generator 
matrix G, as shown in the following theorem. 

Theorem 1 - SISO Encoder: Let x b (n) represent the input soft symbol estimate (SSE) to a channel 
encoder. Then given a generator matrix G = (gi,g2, • • • , g/v) of a rate-1 linear constituent code, 
where g^ is the n-th row of G and zj-th element of G is denoted by g^, £ {0, 1}, the logarithm 
of the SISO encoder outputs for the soft inputs lnx b , denoted by lnx c , can be calculated as 

lnx c = G(lnx b ) T (20) 

The corresponding soft encoder outputs are given by 

x c (n) = exp (lnx c (n)) = exp (g„(lnx 6 ) T ) (21) 

It can be further expressed as 

/ N \ N 

x c (n) = exp (lnx c (n)) = exp ^g n (lnx fe ) T j = exp I y^ y g ni \nx b {i) I = exp (In (x b (i)) 9ni ) 



i=i I i=i 



N 



= i[(x b (i)) 9ni = J] ^(i) (22) 

»=1 i&{U n } 

where Ui = {g^ = l,j = 1,...,7V} is the set of non-zero coefficients in gj = {gn,gi2,--- ,g%N), 
i = l, ...,N. 
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Proof: See Appendix A. 

Note: Theorem 1 is very important, as it formulates a simple SISO encoder structure, which can 
be implemented by using a convolutional encoder structure, but the difference is that the addition 
operation in the SISO convolutional encoder is done in a complex domain, not in binary domain. For 
example, Fig. 2 shows a simple implementation of a SISO encoder for Example 1. We can see that 
the SISO channel encoder can be implemented by adding a logarithm and an exponential module at 
the front and the back of the conventional encoder, respectively. 

B. Modeling of Soft Symbol Estimates 

In this section, we will derive a statistical model for SSE, which will be used for analyzing the 
performance of the DISC scheme in the next section. 

As shown in [6, 8, 21], the SSE of symbol x b (n), denoted by x b (n), can be represented by the 
following model 

x b (n) = x b (n) (1 - w in (n)) = x b (n) (1 - /^) + w in (n) = ax b (n) + w in (n) (23) 

where Wi n (n) = —x b (n) (wi n (n) — //^) is the noise term in the SSE with a zero mean and variance of 
of n , w in (n) > is an equivalent noise independent of x b (n) with a mean /z™(n) and variance of a%, 
and a = 1 — //^. It can be easily verified that x b (n) and w in (n) are independent. 
By substituting Eq. (1231) into (122)) . we have 

x c (n)= Yl %b(j)= Yl ( ax bU) + w in(j)) (24) 
je{u n } je{u n } 

For simplicity, in the following sections, we consider a non-recursive convolutional code (NRCC) 
as the constituent code in the SISO encoder. Let denote by \U n \ the number of elements in U n . For 
the NRCC, we have |Z7 n | = d , which we refer to as the row degree of G or the generator sequence 
weight (GSW) of g PS . Let x c = (x c (l), x c (2), • • • ,x c (N)) represent the modulated sequence of c. 
Then we have 

x c {n) = | [ x b (j) = [ I (ax b (j) + w in {j)) = a do ] f x b (j) + w out (n) = a d °x c (n) + w out (n),(25) 

je{u n } je{u n } je{u n } 

where x c (n) = f] x b (j) is the modulated signal of n-th code bit c(n) of b, and w out (n) is the 
je{u n } 

equivalent noise of the soft encoder output with a zero mean and variance of 

*L=(a 2 +<4) d0 -« Mo (26) 

In the above, we have introduced a SISO encoder. The SISO encoder structure is obtained when 
the inputs to the encoder are the soft symbol estimates (SSE). We can directly apply the above SISO 
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encoder structure to any analog input signals carrying the source symbol information. That is, given any 
analog input signals z b = (z b (l),--- ,z b (N)) containing information symbols x 6 , the corresponding 
£>th SISO encoder output signal x c (k) can be calculated as 

x c (n) = exp (g n (lnz fe ) T ) = exp j ^ g ni ln z b (i) J = JJ z b (j) (27) 

where lnz b = (lnz b (l), ■ ■ • , ln^(iV)). 

Its encoding process can be implemented by a similar SISO encoder as shown in Fig. 2. It is 
important to note, as will be proved below, that the SSE is the optimal input to the SISO encoder in 
terms of maximizing the SISO encoder output SNR. 

Theorem 2: Given an input analog signal carrying the source information symbol, the soft symbol 
estimate of source information symbol is the optimal input to the soft encoder in terms of maximizing 
the SNR of the SISO encoder output. 

Proof: See Appendix B. 

In the following, we all assume that the input to the SISO encoder is the SSE of the source 
information symbol. 

C. Distributed Soft Coding (DISC) based on the SISO Encoder 

In this section, we introduce a distributed soft coding (DISC) scheme based on the SISO encoder 
described in Section 3.1. We assume that there are K relays. The generator sequence and generator 
matrix for relay k are gf s and G^, with row degree of dk, respectively. Let c k = (c k (l), • • • , c k (N)) 
be the codeword of information bits b generated by G^, where c k (n) is the n-th code symbol of 
b. Let x Cfc = (x Cfc (l), x Ck (2), ■ ■ ■ ,x Ck (N)) represent the modulated sequence of c k . Fig. 3 shows the 
proposed encoder structure at relay k. Upon receiving signal, relay k first calculates the SSE of the 
source information symbol, denoted by x bk {n). The relay k then applies the SISO encoder to encode 
x bk (n), based on the given generator sequence g k s , to generate the SSEs of its code sequence c k . Let 
x Ck (n) be the corresponding soft encoder output at relay k at time n. It can be expressed as 

% Ck ( n ) = ( a k) dk x Ck (n) + w outik (n) (28) 

where a k = 1 — ^w,k, ^w,k is the mean of equivalent noise w in (n) in the SSE at relay k shown in (|23l) . 
and w outyk (n) is the equivalent noise at the soft encoder output with a zero mean and variance of 

°out,k = K + a in,k) ~ "fc (29) 

af nk is the variance of the equivalent noise w in (n) in the soft input to the SISO encoder of relay k, 
as shown in (1231) . 
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For simplicity, we assume that all relays transmit at the same power P r . Then the signals transmitted 
from relay k can then be written as 



Xr h {n) = (3 k x Ck (n) 
where (3 k is a normalization factor, given by 

0k = 



(30) 



f Pr/P Xk (31) 

where P Xk = E (|£ c »| 2 ) = {a\ + a^ k ) dk . 

The destination received signal, transmitted from relay k, can be written as 

y rk d{n) = \[L~ r h Tkd x rk {n) + w rkd (ri) = ^/L~ r h rkd [3 k (a d k k x Ck {n) + w out; k{n)\ + w r . kd {n) 

= ^T r h Tkd f3 k a d k k x Ck {n) + w rkd {n) (32) 

where L r is the pathloss from the relay to the destination, w rk d(n) = VL~h rkd /3 k w outik (n) + w rkd (n) 
is an equivalent noise with a zero mean and variance of 

°r k d = °l + L r\h k d\ 2 l3l (a 2 k + a 2 in k ) dk - a k dk (33) 

In the above equation, we have used the fact that E (wi nji (ri)w in; j(n)) = for the BPSK constellation 

[6] and thus E (w outA (n)w outJ (n)) = 0. 

IV. Performance Analysis and DISC Design 

The SISO encoding at the relays can bring system some coding gains, but on the other hand soft 
encoding of noisy SSE will enhance the noise power at the destination, as shown in (|25H26I) . It is 
unclear whether the coding gain can surpass the noise enhancement in the DISC and if such encoding 
can bring any overall gain. Moreover, given K constituent codes, we need to determine what is the 
optimal way of pairing off the K constituent codes with K relays. In this section, we will give a 
quantitative analysis of the DISC scheme performance based on which a coding design criterion is 
then proposed. 

By substituting (I3TI) into (1331) . the variance of the equivalent destination noise in Eq. (1331) can be 
expanded as 



°r k d = °n 



f 2 i 2 \ d k 1 



P T \h 

r-^r | "'r fe d| 



1 - (1 + l/7sr fc ,m) 



(34) 



where 7, 



sr k ,m 



a l/ a in k i s ^e input SNR of the SISO encoder at the k-th relay. 
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Let 7sr fc d represent the instantaneous destination SNR, corresponding to the signals generated by the 
constituent encoder at the A;-th relay. Then from © and (|34|) . we get 



1sr k d 



dk 



L r P r \h rkd 



2 2<4 



a 



I (a* + **,,*) 



dk 



a 



r k d 



cr 2 + L r P r \h 



r k d\ 



lr k d 



1 - (1 + Ihsr^n) 
r Yr k d r ) sr k ,in 



-dk 



(1 + Ihsr^nf" ~ 1 



lr k d + 1 



dklr k d + 7. 



(35) 



sr k ,m 



where 7 rfed = P r L r \h rkd \ 2 /a 2 is the instantaneous SNR in the link from relay k to the destination and 
the last equation is a high SNR approximation. 

Since calculating the exact BER is extremely complicated, we consider an asymptotic performance 
at high SNR, which can give us some insights into the system design. We assume that w rkd {n) can be 
approximated as a Gaussian random variable. Then the BER of the DISC scheme can be approximated 
at high SNR as [21] 

K 



Pb ~ P>d Sree Q 



K 



2 ^2 rf min,fc7sr fc d ~ O.BB dfree exp | - d min ^ srkd 



(36) 



k=l 



k=l 



where d m i n> k is the minimum Hamming weight (MHW) of a nonzero codeword, which is also equal 
to the code minimum Hamming distance (MHD), generated by the constituent encoder of relay k. 

Let d min denote the MHW of a nonzero codeword generated by all K constituent encoders. d min and 
G^mm,*: can be obtained either by simulations or by deriving its bounds. Theorem 3 presents a simple 
bound for d m - m and d m - mjk . 

Theorem 3: Let us consider a non-recursive convolutional code C, generated by K constituent codes 
gf s , g^ 5 , • • • , Zr S - Let d m i ni k represent the MHD of the code generated by the k-th constituent code 
g^ s . Let dram denote by the MHD of the overall codeword generated by K constituent codes. Also let 
W\ t k be the Hamming weight of a codeword generated by the k-th constituent encoder for the input 
sequence of (1 • • • 0). Then we have the following simple bound for (i min and c? min fc, 



K 



dm'm,k < w 1>h = 4, and d min <^d k 



(37) 



k=l 



where d k is the row degree of the generator matrix for the A;-th constituent code, which is equal to the 
number of Is in its generator sequence g k s . We refer to d k as the generator sequence weight (GSW) 
of gf s . 

Proof of this bound is straightforward and we omit it here. Table 1 shows the exact MHDs and the 
MHD bounds calculated in (1371) for rate 1/2, 1/3 and 1/4 codes with various memory lengths. The 
codes are obtained from [20]. We can see that the difference between the bound in Eq. (|37l ) and the 
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exact MHD is at most 1 for the codes listed in the table and for most of the codes the bound is equal 
to the exact MHD. 

By using the MHD bound in Theorem 3, the BER in Eq. (|36l) can be further approximated as 



dmm,klsr k d I ~ 0.5-B d/ree exp I - ^ 47sr fc d I 
k=l J \ k=l J 



K , \ / K 



P b « 0.5B dfree exp 
~ 0.5B dfree exp 

= 0.5B dfree exp ( - ^ Pk ( d k, lr k d, lsr k ,in) ) ( 38 ) 



£ , 47rfed7 ^- m = 0.55^ exp - £ =i 

k=l dklr k d + lsr k ,in J \ fc=1 7 rfc d"fc + 7sr fe ,i 



A" 



fc=l 



where 



Pfc (,«fc, 7r fc d, lsr,in,k) = ,_i 

7sr fc ,m"fc + 7r fc d 

We can see from Eqs. (I38H39I ) that P b and Pfc (<ifc, 7r fc d, 7sr fc ,m) are a monotonic decreasing and 
increasing function of c4, respectively. To reduce the error rate Pb, one should make the GSW c4 
as large as possible by increasing its memory length, as with the conventional convolutional codes. 
However, dk, k = 1, . . . , K cannot be chosen arbitrarily as the code may become catastrophic for certain 
combinations of GSW values. The code construction has to be non-catastrophic. Some examples of 
good non-catastrophic codes are shown in Table 1 for various code rates. We can see from these tables 
that for most of good codes, GSWs are different for different k. Given K GSWs of K constituent 
codes (g?i, d 2 , . . . , dx), we need to determine what is the optimal way of pairing off the constituent 
codes with relays. That is, which constituent code should be used in which relay? 

To answer this question, let us first order 7 srfci j n in a decreasing order and denote the reordered SNR 
values as (j srm ,in,7s n2) ,in, • • • ,lsr iK) ,mj, where 

7s»"(l),in — 7sT(2),«™ — ' " " — 7s77jf)|Wl (40) 

Similarly we also re-order (di, d%, . . . , dx) in a decreasing order as follows, 

d(i) > d {2) >■■■> d {K) (41) 

Then we have the following theorem regarding optimally pairing the constituent codes with the 
relays for AWGN channels. 

Theorem 4 - Design Criterion of DISC for AWGN Channels: Let us consider a parallel relay network 
consisting of K relays over AWGN channels. We assume that all relays have the same transmission 
power and experience the same path loss, that is, = ^ r d for all k — 1, . . . , K. In the DISC, each 
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relay performs a SISO encoding, where the existing good convolutional codes or other linear codes 
can be chosen as the relay constituent codes. Assume that a good convolutional code generated by 
K constituent convolutional codes gf s , gf s , • • • , gf 5 , has already been found. Let us denote by d fe 
the GSW of gf s . Then the optimal code construction in AWGN channels is to assign the code with 
the A;-th largest GSW to the relay node with the A;-th largest input SNR 7 sr(fc)) j n . In this way, the 
system achieves the optimal BER performance for given constituent codes with generator sequences 

gP S (-fP S gfPS 
1 ) &2 j - * - > £>K ■ 

Proof: See Appendix C. 

From the above theorem, we can see that in order to minimize the BER P b for the given K GSWs 
(d(i),d( 2 ), • • • ,d{K)), we should match the GSW values to the corresponding input SNRs and assign 
the constituent code with a large GSW value to the relay with a large SNR. 

Let 7 srfc be the average SNR in the link from the source to relay k. Then by using the fact that 
7sr (fc) ,m is monotonically increasing function of 7 srfe , we have the following Corollary. 

Corollary 1: The optimal code construction of DISC for AWGN channels is to assign the code with 
the k-th largest GSW drjA to the relay node with the k-th largest average SNR 7 srfc . 

To show the gain of the DISC with the optimal pairing over a DISC with un-ordered pairing and 
the soft information relaying (SIR), let us consider a simple example. 

Example 2: We consider a rate 1/2 convolutional code of memory length of 3. The generator 
sequences of two constituent codes are gf 5 =(101) and gf 5 =(111). Then we have = 3 and d( 2 ) = 2. 

We consider an AWGN channel and assume that the average input SNR of relay 1 is larger than 
that of relay 2. Then we have 7 srii j n > 7 S r 2 ,m- 

Then according to Corollary 1 the optimal pairing strategy is to assign the constituent code gf 5 =(1 11) 
with the maximum GSW to relay 1 with the maximum SNR 7 srii j ri and gf 5 =(101) with the minimum 
GSW to relay 2 with the minimum SNR 7 sr2ii „. 

To show the performance gain of the proposed scheme, we assume that 7 srij j„ = 7 3ap 7rd, where 
lga P = ls ri ,in/lrd and 'j sri ,i n / 1sr 2 ,in = «o, "o > L Then for an un-ordered pairing, we assume that 
gf s and gf 5 are assigned to relays 1 and 2, respectively. Then we have di — 2 and d 2 = 3 and 

Pi (dl, Ird, lsr u in) = , , , = , (42) 

^ fsr 1 ,zn u 'l * fgap )sn,m) i9 a PI ' L 

un-order (i \ 1 gap l sr u inl sr 2 ,in n fsr 1 ,in rA ^ 

P 2 {d2,lrd,lsr 2 ,in) = ~, ^37" ~ V = T7^ ZTT ^ 

\lsr 2 ,in d 2 + Igaplsruin) V^T gap + «0 
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■un— order \ ^ un-order i > „, \ lsr\,in . lsri,in 

~ 7W 2 + 1 7ga P /3 + a 



5/ 3 7</a P + 2(1 + a ) 



For the optimal pairing, we have 



pT 



d(i), 7rd, 7,r (1) ,m ) = 7 7 = 77— (45) 

X 7 ' T • d7\ + 'Y~ 1 T • I 7gap/3 + l 

Jan, in" 1 (2) * lgap Jsn,m J 



opt f j \ lgaplsr\,inlsr2,in Jsri.in r A ^\ 

V 7 I'Y ■ d7j +'Y- 1 'Y ■ 1 79ap/2 + a 

P ^Pk [d ik) ,lrd,lsr (h) ,n) lgap/3 + 1 + lgap /2 + a %r ^ n { ( lgap /3 + 1) { lgap + 2a ) r 
Similarly, for the conventional soft information relaying scheme, d\ = &i = 1, and we get 

J5IR /-I \ 7gqp7^ri,m7sri,m Tgn^in 

Pl (1, 7rd , 7srijin ) = - (48) 

^ /sn,m 7" lgap Jsri,m) \ I gap ' -v 

(7sr 2 ,m + 7 S op7sri,in J l7 9 ap + «oJ 

n 57/? _ n S/i? / j \ _ Tgnjn 7sn,m _ / 2 7gap + (1 + Q ) \ 

P - y,Ph { d k, Jrd, Jsr k ,in) ~ 7 — V + 7 . 7 ~ lsr u in ~T~ . , — PO) 

£^ (7 9 ap+ 1 ) (7 9 a P + «0j V(7 9 ap + l)(7gap + ao)/ 

Then we have 

opt nn-order 7gap (go ~ 1) (57gap + 6(1 + Op)) 

P P = 7 T^w r~o — w T^VT — 77sn,m > (51) 

(7 9 ap + 3) ( 79ap + 2a ) (7 5 ap + 2) ( 7 g ap + 3a ) 

p o P t_ p SIR = %a P (Hap + ( 4 + ^o)lgap + + 3)) ^ , Q (52) 

(7 9 ap + 3) ( 7flap + 2a ) (7gap + 1) (7gap + "o) 

popt _ pun-order an( j ^opt _ pSm coding gains of the DISC with the optimal code pairing 

over the DISC with an un-ordered pairing and the conventional SIR scheme, respectively. From Eqs. 
(151H52I) . we can see that the DISC with the optimal pairing outperforms the DISC with an un-ordered 
pairing and the conventional SIR scheme at high SNR. 
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V. Simulation Results and Discussions 

In this section, we present the simulation results. All simulations are performed for the BPSK 
modulation and a frame size of 130 symbols over AWGN and quasi-static fading channels. We assume 
that all relays use the code with the same number of states. Thus if there are K relays, the convolutional 
code of rate 1/K with K constituent codes can be used in K relays, and each relay uses one constituent 
code. For example, for the relay network with 2, 3 and 4 relays, the convolutional codes listed in Table 
1 can be used as constituent codes at the relays. All schemes are compared under the same power 
constraint. 

Figs. 4-5 compare the frame error rate (FER) performance of soft information relaying (SIR), the 
proposed DISC with optimum and un-ordered code pairing, as well as the conventional decode and 
forward (DF) for various numbers of states over AWGN channels for 7 sr = 7 rd , 7 sr = 7 rd +3dB, 
respectively. We also set 7 sri = 7 sr and 7 sr2 = 7 sr + 3<iB. Here the optimal and un-ordered assignment 
is the same as the assignment given in Example 2. It has been shown in [6, 21] that the SIR scheme 
is an SNR maximizing estimate and forward protocol and it always outperforms the AF, so we only 
need to put the SIR scheme as a reference. 

We can first note from these figures that the performance of the DF gets worse as the number of 
relay encoder states increases. Such performance degradation is due to the error propagations in the 
DF scheme. In the DF scheme, when decoding errors occur at the relays, the process of decoding and 
encoding causes errors to propagate into subsequent symbols. The longer the encoder memory, the 
larger the number of subsequent symbols affected by the decoding errors. Therefore, the error rate of 
the DF will increase with the number of states. For example, Fig. 5 shows that the FER performance of 
the DF for the 4-state and 8-state codes is worse by 0.5dB and 0.7dB, respectively, than for the 2-state 
code at the FER of 1CT 3 . However, the SISO encoder in the proposed DISC scheme can effectively 
mitigate the error propagation in the relay encoding process and at the same time provide a significant 
distributed coding gain. As a result, the DISC provides significant coding gains compared to the SIR 
without relay encoding and the gain increases as the number of states increases at high SNR. For 
example, as shown in Fig. 5, the DISCs with 2, 4 and 8-state are superior to the SIR by about 1.4dB, 
1.8dB and 2dB, respectively. This result is consistent with the analysis in Section 4, showing that the 
DISC performance improves as the number of states at the relay encoder increases. Furthermore, we 
can also see from the figures that the DISC with optimal code pairing also brings significant gains 
compared to the DISC with the un-ordered pairing. For example, as shown in Fig. 5, the 4-state code 
with the optimal code pairing is superior to that with the un-ordered pairing by 2dB at the FER of 
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1CT 3 . This validates the effectiveness of the proposed design criteria. 

Figs. 6-7 compare the performance over fading channels for a network with 2 relays for 7 sr = % d , 
Isr — Ird +10dB, respectively. We set 7 sri = 7 sr2 = 7 sr . It can also be observed from the figures that 
the DISC and SIR can achieve the full diversity order of 2, but the conventional DF can only achieve 
the diversity order of 1 due to error propagation. The DISC substantially outperforms the SIR scheme 
over fading channels too. For example, the DISC with 2, 4 and 8 states can bring about 0.7dB, 1.5dB 
and 1 .7dB gains, respectively, relative to the SIR scheme, for 7 sr = *y rd and the gains are increased to 
ldB, 2dB and 2.5dB, respectively, for 7 sr = 7 rd +10dB. That is, the coding gain brought by the DISC 
increases when the source-relay link quality is improved. We can also observe that the coding gain 
increases as the number of relay encoder states increases. 

Figs. 8-11 show the results for three relays over AWGN and fading channels, respectively. From 
these figures we can observe similar trends as for the case with two relays. That is, the DISC can 
bring significant gains over the SIR and DF on both AWGN and fading channels and the gains increase 
as the number of state increases. For the fading channels, both DISC and SIR schemes can achieve 
the full diversity order of 3 while the DF can only achieve the diversity order of 1. Also pairing can 
bring system considerable gains over AWGN channels. Furthermore, the coding gain of DISC over 
SIR slightly increases as the number of relay increases from 2 to 3. 

From the above results, we can see that the relay encoding in the conventional DF schemes cause 
serious error propagation and thus does not provide any coding advantages. By contrary, the proposed 
DISC can effectively mitigate the error propagation in the relay encoding and provide significant 
distributed coding gains, thus substantially outperforming the soft information relaying (SIR) and 
conventional DF schemes. 

VI. Conclusions 

In this paper we proposed a new distributed soft coding (DISC) scheme based on a soft input 
soft output encoder at the relay and the optimal design criteria were proposed. The proposed scheme 
performs encoding of the noisy source symbols estimates in error-prone relay channels. It can effectively 
circumvent error propagation in the relay encoding process and at the same time provide significant 
distributed coding gains. It provides great performance improvement compared to the soft information 
relaying (SIR) and conventional DF schemes. At high SNR the gain further increases as the number 
of state increases. 

In this paper, we have only considered the design of DISC schemes based on the convolutional codes. 
However, the DISC can be applied to other channel coding schemes, which can be described by a 
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generator matrix. Thus DISC provides a simple and general way to carry out distributed channel coding 
on error-prone parallel relay channels. Furthermore in the analysis and simulations we approximated 
the distribution of the overall destination noise as the Gaussian distribution. As shown in [7, 21], 
the actual distribution is may not follow the exact Gaussian distribution. Further improvement can be 
expected when the accurate distribution of the overall destination noise is derived, but unfortunately 
it has been a challenging topic so far. 

VII. Appendix 

A. Proof of Theorem 1 

To prove this theorem, let us first prove the following Lemma. 

Lemma 1: Let c(i) be the z-th output symbol of a binary encoder generated by G for source binary 
sequence b = (b(l), • • • , b(N)). It is given by 



N 
n=l 



gjb T = ^ 9inb(n) (53) 



where the summation is over GF(2). Let h(n) = In (Pr(6(n) = 0)/Pr(6(n) = 1) represent the log 
likelihood ratio (LLR) of b(n). Then the LLR of c(i), denoted by l c (i), can be calculated as follows 

W Pr(c(,:) = l) 1 - ILg,, tanM«n)/2) 



where tanh(x) — e2x+1 ■ 

The Lemma 1 can be directly proved by using the L-algebra [19] 



1 + r£-i tanh(Z 6 (n„)/2) 

/ (6(m) © 6(n 2 ) • • • © b(n k )) = In L (6(m) © 6(n a ) • • • © b(n k )) = In ^ ; qJ ' (55) 

1 - n g =i tan M^K)/2) 

where L(x) and l(x) denote the likelihood ratio and LLR of x, respectively. 

From Lemma 1, we can easily prove the Theorem 1. Let Xb(k) and lb (k) represent the SSE and 

LLR of source bit b(k). Then they have the following relationship, 

£i§ (56) 

x b (k) = tanh (l b (k)/2) = eXP [^||"j (57) 

exp (/&(«)) + 1 

By substituting Eq. (1571) into (1541 ), we have 

/ eW =ln l±M^ (58, 
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Then by using the relationship of the SSE and LLR in Eq. (|57l) . the SSE of c(k), denoted by x c (k), 
can be calculated as 



x c(k) = U igL r. Bb(j) = ex P (gfc(lnx fe ) T j (59) 

This proves Theorem 1. 

B. Proof of Theorem 2 

From Eqs. (1251) and (l26l) . the output SNR of SISO encoder is given by 

al _ 1 _ 1 

lsr,out o 7i I 2 / 9\nn -T "7^ ^1 \ "0 7 v*"/ 

Vlut (1 + ^n/" 2 ) - 1 (1 + 7srin) " 1 



where 7 sr , in = a 2 /of n 

We can observe from Eq. (l60l) that in order to maximize 7 sr ,aut> we need to maximize Jsrm- 

It has been proved in [6] that the SSE is the SNR maximizing estimate of the source symbols. Thus, 

the SSE is the optimal input to the SISO encoder in terms of maximizing the SNR of SISO encoder 

output. This proves the Theorem 2. 

C. Proof of Theorem 4 

To prove the theorem, we need to use the following Lemma. 

Lemma 2: Given the positive real numbers V\ > v 2 > and 61 > 2 > 0, the following relationship 
always holds, 

1 + 1 > 1 + 1 (61) 

V 1 + 01 v 2 + 2 V\ + 8 2 V 2 + 61 

The proof of the above result is straightforward and we omit it here. Now let us use the Lemma to 
prove Theorem 4. 
Since 

^1r k d 7rd 

for all k = 1, . . . , K, we can rewrite pk (c4, 7rd, lsr k ,in) as follows 

I j \ 1rd1sr k ,in 1 1 
Pk [dk, 7rrf, 1sr k ,in) = "p]— = ~ ,_i , , "I = 7~ , fl s (62) 

%r k ,in a k + 7rd (a fc 7rd) + 

sr k ,in) \ k ~ u k) 

where w fc = (47 rd )~ 1 and fe = (7 srfcli „) -1 . 

Let f(i), f( 2 ), . ..,v<k) and 0m, 0( 2 \, ...,9(k) represent the re-ordered values of V\, v 2 , ■■■,Vk and 
01, 2 , • • • ,0x- Then from Eqs. (© and (gTJ), we have 

V(i) < v {2 ) ■ ■ ■< v (K) and (1) < (2) • • • < 9 {K) (63) 
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Now let us determine how to distribute {f(i), ■ • • , V(k)} and {9^, ■ ■ ■ , 0{k)} to form K pairs (t> fc , fc ), 
= 1, . . . , K, where any vu\ or 9u-\ can only be assigned to one and only one pair, so as to maximize 

K 

Yl Pk (^fe) Irdi lsr k ,in)- As can be seen from Eq. (1621) . this is equivalent to maximizing 

k=i 

z« = t^hk=tfM) («) 

k=l k=l 

where / (v k , 9 k ) = (v k + fl*.) -1 . 

We assume that the optimal K pairs of for k — 1, . . . , K, are (u(i), 9j\ (vp), 0j 2 ),. . ., (v(k), @j K )- 
Now we prove this theorem by contradiction. Assume that 9j 1 , 9j 2 , . . . , 9j K do not exactly follow the 
relationship of 9^ < 9j 2 ■ ■ ■ < 9j K . Then there must exist at least two integers p, q, such that 9j > 9j q 
for p < q. Since V( q ) > V( p ) and 9 jp > 9 jq , then by using the Lemma 1, we have 

/ ( u (?)> Up) + f ( v (p)> 9 k) > f ( v iih e k) + / ( v (p)i 9 3v) ( 65 ) 

This means that when we switch 9j q and 9j p in the two pairs (v( p ),9j p ) and (v( q ),9j q ), leading to a 
new two pairs (u( p ), 9j q ) and (f( g ), 0j p ), while keeping other pairs unchanged, the resulted H K will be 
larger. This contradicts that (vm, 9jA , ■ • • , (ytK), 9j K ) are me optimal pairs achieving the maximum 
Sx- Therefore, the optimal pairs are (f(i), , (v(2), ^(2)) , • • • j (^(-Rr), ^(-RT))- This proves Theorem 4. 
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TABLE I 

Comparison of Exact MHD and MHD Bound in Theorem 3 for Rate 1/2, 1/3 and 1/4 codes, where the generator 

POLYNOMIAL ARE GIVEN IN OCTAL FORM 



Rate 


Memory 
length 


Si 


GSW 




GSW 
of gf 


gf 


GSW 
of gf 


GS 


GSW 
of gf 


Exact 
MHD 


MHD 
bound in 
Eq. (29) 


1/2 


3 


5 


2 


/ 


3 










5 


5 


1/2 


4 


15 


3 


17 


4 










6 


7 


1/2 


5 


25 


3 


35 


4 










7 


7 


1/2 


6 


53 


4 


75 


5 










8 


9 


1/2 


7 


155 


5 


171 


5 










10 


10 


1/2 


8 


247 


5 


571 


6 










10 


11 


1/2 


9 


561 


5 


753 


7 










12 


12 


1/2 


10 


1167 


7 


1545 


6 










12 


13 


1/2 


11 


2535 


7 


3661 


7 










14 


14 




1/3 


3 




2 


7 


3 


7 


3 






8 


8 


1/3 


4 


13 


3 


15 


3 


17 


4 






10 


10 


1/3 


5 


25 


3 


33 


4 


37 


5 






12 


12 


1/3 


6 


47 


4 


53 


4 


75 


5 






13 


13 


1/3 


7 


133 


5 


145 


4 


175 


6 






15 


15 


1/3 


8 


225 


4 


331 


5 


367 


7 






16 


16 


1/3 


9 


557 


7 


663 


6 


711 


5 






18 


18 


1/3 


10 


1117 


6 


1365 


7 


1633 


7 






20 


20 




1/4 


1 


5 


2 


7 


3 


7 


3 


7 


3 


10 


11 


1/4 


4 


13 


3 


15 


3 


15 


3 


17 


4 


13 


13 


1/4 


5 


25 


3 


27 


4 




4 


37 


5 


16 


16 


1/4 


6 


53 


4 


67 


5 


71 


4 


75 


5 


18 


18 


1/4 


7 


135 


5 


135 


5 


147 


5 


163 


5 


20 


20 


1/4 


8 


235 


5 


275 


6 


313 


5 


357 


7 


22 


23 


1/4 


9 


463 


5 


535 


6 


733 


7 


745 


6 


24 


24 


1/4 


10 


1117 


6 


1365 


7 


1633 


7 


1653 


7 


27 


27 



22 




Destination 



Fig. 1. The block diagram of a 2-hop relay system 
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Fig. 2. SISO channel encoder of Example 1, where the addition is done in the complex field 
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Fig. 3. The encoder structure at relay k in DISC 
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Fig. 4. FER for 2 relays in AWGN Channels, 7 ar = r y ari — 7 s ,- 2 — 3dB, y sr = 7 r( j 




Fig. 5. 



FER for 2 relays in AWGN channels, 7 sr = js ri = 7sr 2 — 3dB, 7 sr = jrd + 3dB 
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Fig. 8. FER for 3 relays in AWGN Channels, "/ sr = 7 sri = 7sr 2 — IdB = j sr3 — 4dB, y sr — j r< i 




Fig. 9. FER for 3 relays in AWGN Channels, "/ ar = 7sr,i = 7sr 2 — 2dB = 7 ar3 — 4dB, 7 sr = j rc i + 3dB 



